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(54) VIDEO HIERARCHY ENCODER 

( 57 ) Abstract : 

PROBLEM TO BE SOLVED: To obtain the video hierarchy encoder that employs frame 
thining by which image information is transmitted with high efficiency. 
SOLUTION: A basic hierarchy encoder 11 has a frame skip control device inside and 
it conducts the frame skip control according to prescribed algorithm. An extended 
hierarchy encoder 12 calculates a frame rate (c) based on an information amount 
produced as a result of coding, an output buffer occupancy amount (e), and 
informs a coding object frame decision device 14 of it. The encoding object frame 
decision device 14 obtains a means frame interval based on the frame rate fed 
from both the coders 11, 12 to decide a coding object frame (d) . The extended 
hierarchical coder 12 encodes the decided frame to select at least a frame of one 
layer so as not to be in duplicate with subordinate hierarchical frames. 
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CLAIMS 



[Claim(s) ] 

[Claim 1]A video hierarchical encoding device possessing a frame selecting means 
which is a video hierarchical encoding device which codes an image frame 
selectively, and chooses at least one hierarchy's frame so that it may not lap 
with a low-ranking hierarchy's frame. 

[Claim 2] A video hierarchical encoding device applying interframe predictive 
coding on the basis of a low-ranking hierarchy's frame to coding of a frame 
selected by said frame selecting means in the video hierarchical encoding device 
according to claim 1 . 

[Claim 3]A video hierarchical encoding device coding a frame selected by said 
frame selecting means by interframe predictive coding regardless of a low-ranking 
hierarchy's frame in the video hierarchical encoding device according to claim 1. 



[Claim 4] A means which estimates the 1st hierarchy's frame rate in the video 
hierarchical encoding device according to any one of claims 1 to 3, the 2nd 
hierarchy's frame generated information — this — the bit rate for the 2nd 
hierarchy transmission. And provide further a means which estimates this 2nd 
hierarchy's frame rate, using the amount of buffer information at least, and said 
frame selecting means, A video hierarchical encoding device asking for an average 
frame interval based on the 1st and 2nd hierarchy's frame rate estimated by said 
each means, and choosing the 2nd hierarchy's coding object frame based on this 
average frame interval. 

[Claim 5] In the video hierarchical encoding device according to claim 4, said 2nd 
hierarchy's coding object frame, A video hierarchical encoding device using a 
frame which separated only an average frame interval from this frame with an 
already coded frame as the starting point on the 1st hierarchy as the 2nd 
hierarchy's coding object frame. 

[Claim 6] In the video hierarchical encoding device according to claim 4 or 5, 
said 1st hierarchy's coding object frame, A video hierarchical encoding device 
characterized by considering it as this 2nd hierarchy's coding object frame when 
a frame interval with said 2nd hierarchy's coding object frame is smaller than 
1/n (n is 1< n<3 here) of said average frame interval. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invent ion ] Especially this invention is used for the digital 
compression which enables playback of a video signal from some compressed data of 
a video signal about a video hierarchical encoding device, and relates to a 
suitable video hierarchical encoding device. 

[0002] 

[Description of the Prior Art] Conventionally, there is scalability art specified 
by MPEG-2 as art which codes a video signal hierarchical to a basic layer and an 
extended layer. When the part of the encoded bit streams is decoded, this 
scalability art can reproduce an image with low space resolutions and the 
remaining data in a bit stream is decoded further for example, it is the art in 
which an additional signal which raises space resolutions is acquired. 

[0003] 

[Problem(s) to be Solved by the Invent ion ] Scalability art specified by above 
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MPEG-2 is premised on all the frames of video being coded, and any consideration 
is not carried out about the inter-frame length (frame skip) needed in low bit 
rate video transmission, either. Since scalability art had the complicated 
operation, there was a problem that processing of the software in a personal 
computer was comparatively difficult. 

[0004] The purpose of this invention is to provide the video hierarchical encoding 
device using inter-frame length which is made in view of the above mentioned 
conventional technology, and can transmit picture information efficiently. Other 
purposes are to provide a video hierarchical encoding device suitable for 
carrying out video transmission of the low speed line top, such as the Internet. 

[0005] 

[Means for Solving the Problem] In order to attain the aforementioned purpose, 
this invention is a video hierarchical encoding device which codes an image frame 
selectively, and the 1st feature is at a point of having provided a frame 
selecting means which chooses at least one hierarchy's frame so that it may not 
lap with a low-ranking hierarchy's frame. 

[0006] A means by which this invention estimates the 1st hierarchy's frame rate 
and the 2nd hierarchy's frame generated information, this — a means which 
estimates this 2nd hierarchy's frame rate being provided further, using the bit 
rate and the amount of buffer information for the 2nd hierarchy transmission at 
least, and said frame selecting means, It asks for an average frame interval 
based on the 1st and 2nd hierarchy's frame rate estimated by said each means, and 
the 2nd feature is that it chose the 2nd hierarchy's coding object frame based on 
this average frame interval. 

[0007] Image quality can be raised, when a frame rate transmitted increases and 
these frames are decoded, since a frame of a higher rank or the 2nd hierarchy 
stops overlapping with a frame of a low rank or the 1st hierarchy according to 
said the 1st and 2 feature. 

[0008] 

[Embodiment of the Invent ion ] Below, with reference to Drawings, this invention is 
explained in detail. First, the principle of a 1st embodiment of this invention 
is explained with reference to drawing 1 . 

[0009] This embodiment performs H.263 baseline coding as a basic layer (BL), and 
performs bidirectional prediction coding (B-picture) as the 2nd extension 
hierarchy (EL2), using SNR scalability as the 1st extension hierarchy (ELI) . SNR 
scalability carries out prediction coding of the information for recovering the 
information lost by the basic layer's coding here. Each -> of a graphic display 
means prediction coding. It is the same also at the following figures. 

[ 0 0 1 0 ] According to this embodiment, a basic layer can be made to improve frame 
image quality by adding the 1st extension hierarchy. Since the 2nd extension 
hierarchy's frame is made to code by choosing the frame which was not chosen on a 
basic layer and the 1st extension hierarchy (B-picture), if this 2nd extension 
hierarchy is decoded further, a frame rate can increase and it can raise image 
quality. The method of selection this 2nd extension hierarchy's frame is later 
mentioned about drawing 4. 

[0011] Next, the principle of a 2nd embodiment of this invention is explained with 
reference to drawing 2. Although this embodiment is the same as that of a 1st 
embodiment about coding of a basic layer and the 1st extension hierarchy, the 
feature is at the point of choosing the frame which was not independently chosen 
on these hierarchies in the 2nd extension hierarchy for these hierarchies, and 
having been made to perform prediction coding. Intra coding (I-picture) and 
forward direction prediction coding (P-picture) perform this 2nd extension 
hierarchy's prediction coding. Also in this embodiment, if the 2nd extension 
hierarchy is decoded further, a frame rate can increase and image quality can be 
raised . 

[0012] Next, the principle of a 3rd embodiment of this invention is explained with 
reference to drawing 3 . This embodiment has the feature in the point in which 
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each hierarchy chooses independently the frame which was not chosen on a 
low-ranking hierarchy,, and each of the basic layer, the 1st extension hierarchy, 
and the 2nd extension hierarchy was made to carry out prediction coding. 
According to this embodiment, if the 1st extension hierarchy and the 2nd 
extension hierarchy are decoded, a frame rate is improvable twice when only a 
basic layer is decoded, and 3 times, respectively. 

[0013] Next, in said each embodiment, one example of a means to determine a coding 
object frame is explained with reference to drawing 4. The solid line of a figure 
expresses data flow and a dotted line expresses the flow of a control signal and 
a parameter. 

[0014] The image data which should be coded inputs into the basic layer coding 
equipment 11 and the extended hierarchical encoding device 12. As the basic layer 
coding equipment 11, H.263 baseline coding can be used, for example. This basic 
layer coding equipment 11 performs frame skip control according to the algorithm 
specified to TMN which is the known art which has a frame skip control mechanism 
in the inside, for example, is exhibited from ITU. The data coded with this basic 
layer coding equipment 11 is sent out on the line 13. This basic layer coding 
equipment 11 outputs the frame rate (frame per second) in a basic layer, and the 
information a on a coded frame to the coding object frame deciding device 14. 

[0015]As the extended hierarchical encoding device 12, the bidirectional coding 
which is the time scalability specified, for example to H.263, H.263 baseline 
coding, etc. can be used. This extended hierarchical encoding device 12 codes an 
image frame according to the directions from the coding object frame deciding 
device 14. When performing this coding, in response to the notice of the image 
quality parameter b, for example, normal child-ized step size etc., it codes from 
the basic layer coding equipment 11 so that image quality may become uniform on a 
basic layer and an extended hierarchy. And the frame rate c is computed from the 
amount of information e generated as a result of coding, and the target bit rate 
f defined beforehand, and it notifies to the coding object frame deciding device 
14. It can ask for this frame rate c, for example by c=f/e. 

[0016] For example from the basic layer coding equipment 11, if each frame rate of 
B frames per second is received from the extended hierarchical encoding device 12 
A frame per second, the coding object frame deciding device 14, Average frame 
rate (A+B) frames per second and 30/ (A+B) of average frame intervals when both 
hierarchies are doubled are calculated. 30 is a frame number per second here. And 
the frame which left only a 30-/ (A+B) frame with the frame as the starting point 
coded on the frame or extended hierarchy coded by said basic layer is determined 
as a frame which should be coded on an extended hierarchy. When 30/ (A+B) is not 
an integer at this time, it is good to round off and use for the nearest integer. 
The selected frame removes this frame from a coding subject, when nearer, for 
example than {30/ (A+B) } / n frame, the frame coded by the basic layer, and. 
Although n should just be the bigger real number than 1, 2 is preferred here, for 
example . 

[0017] If it is the frame rate [ in / now / the basic layer coding equipment 11 ] 
A= 3 when an example explains with reference to drawing 5, and the frame rate B= 
7 computed with the extended hierarchical encoding device 12, As 30/ (A+B) is set 
to three and said coding object frame deciding device 14 is illustrated by the 
extended hierarchical encoding device 12 by the solid line facing-up arrow, The 
frame which should be coded every three frames with the frame as the starting 
point coded on the frame or extended hierarchy coded by the basic layer is 
directed. If it points to the frame which should be coded every three frames in 
this way and goes, will become a frame to which the 9th frame, the 19th frame (it 
writes by a dotted line), etc. correspond, but. Since it is separated only from 
the frame coded by the basic layer, and one frame of these frames, they are 
removed from a coding object frame. 

[0018] As mentioned above, when the frame which should be coded with the extended 
hierarchical encoding device 12 was determined using the embodiment of drawing 4, 
after protecting a basic layer + extension hierarchy's frame rate, When it will 
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be chosen so that it may become equivalent, without the selected frame inclining, 
and these frames are decoded, image quality better than before comes to be 
obtained . 
[0019] 

[Effect of the Invent ion ] Since the coding object frame of a higher rank or the 
2nd hierarchy can be changed with the coding object frame of a low rank or the 
1st hierarchy according to this invention so that clearly from the above 
explanation, The frame rate transmitted can be made to increase and image quality 
can be raised now compared with the conventional method. 

[0020] By using as a coding object frame the frame which left only the average 
frame interval with the low rank or the frame as the starting point whose 1st 
hierarchy has been coded, It is related with the whole image frame, and the 
coding object frame of a higher rank or the 2nd hierarchy can be selected or 
extracted now with sufficient balance. Compared with the conventional scalability 
art, an operation becomes easy substantially. The effect is large when this 
invention is applied to video transmission on low speed lines, such as the 
Internet . 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l]It is an explanatory view of a 1st embodiment of this invention. 

[Drawing 2] It is an explanatory view of a 2nd embodiment of this invention. 

[Drawing 3] It is an explanatory view of a 3rd embodiment of this invention. 

[Drawing 4] It is a block diagram showing one example of a coding object frame 
determination means. 

[Drawing 5] It is an explanatory view of the coding object frame determined by 
said coding object frame determination means. 
[Description of Notations] 

11 — Basic layer coding equipment, 12 — An extended hierarchical encoding 
device, 14 — Coding object frame deciding device. 
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